Perspectives of African American Social Workers Regarding Clinical Licensure.

PURPOSE: This study was undertaken to illuminate the perspectives of African American MSWs, both licensed and unlicensed, concerning clinical licensure. METHOD: In 2022, but prior to the time of the Association for Social Work Boards (ASWB) report release, the primary author interviewed 20 African Americans with Master of Social Work (MSW) degrees regarding their desire and attempts to attain licensure. The participants were selected utilizing non-probability, convenience sampling methods and self-selected in response to invitations extended via social media platforms. The interviews took place via Zoom and were recorded and analyzed utilizing qualitative methods. RESULTS: The findings suggested that many interviewees do view the test as biased in favor of White women and that they attribute lower test pass rates of African Americans in part to this bias. However, additional concerns, including the costs and difficulty of multiple test-taking efforts, the time limit between MSW and licensure, and the dearth of information available to MSWs about licensing credentials, among others, were also cited. Respondents also identified, in some cases, limitations in social support, particularly in work settings, for their professional development efforts. Significantly, many participants identified problems with supervision - securing supervision, the focus/content of supervision, or both. DISCUSSION AND CONCLUSIONS: Recommendations for steps to increase access to the test and to information about the test are offered. Importantly, discussion regarding avenues to supervision and mentorship is initiated. This study offers a first step in the process of engaging with African Americans about their own experiences with the licensing process.

Tracking cognition with the T-MoCA in a racially/ethnically diverse older adult cohort.

Introduction: We investigated the utility of the Telephone-Montreal Cognitive Assessment (T-MoCA) to track cognition in a diverse sample from the Einstein Aging Study. Methods: Telephone and in-person MoCA data, collected annually, were used to evaluate longitudinal cognitive performance. Joint models of T-MoCA and in-person MoCA compared changes, variance, and test-retest reliability measured by intraclass correlation coefficient by racial/ethnic group. Results: There were no significant differences in baseline performance or longitudinal changes across three study waves for both MoCA formats. T-MoCA performance improved over waves 1-3 but declined afterward. Test-retest reliability was lower for the T-MoCA than for the in-person MoCA. In comparison with non-Hispanic Whites, non-Hispanic Blacks and Hispanics performed worse at baseline on both MoCA formats and showed lower correlations between T-MoCA and in-person versions. Conclusions: The T-MoCA provides valuable information on cognitive change, despite racial/ethnic disparities and practice effects. We discuss implications for health disparity populations. Highlights: We assessed the comparability of Telephone-Montreal Cognitive Assessment (T-MoCA) and in-person MoCA for tracking cognition.Changes within 3 years in T-MoCA were similar to that for the in-person MoCA.T-MoCA is subject to practice effects and shows difference in performance by race/ethnicity.Test-retest reliability of T-MoCA is lower than that for in-person MoCA.

Brief Report: An Evaluation of Item Bias on the Functional Activities Questionnaire.

OBJECTIVE: To evaluate whether the Functional Activities Questionnaire (FAQ), a commonly used measure of functional status in neurodegenerative disease research, performs equivalently across demographically diverse subgroups of participants. METHOD: The FAQs from 30,613 National Alzheimer's Coordinating Center participants were evaluated with a hybrid graded response model-logistic ordinal regression approach to determine the presence of differential item functioning (DIF) within five demographic groups: education, ethnicity, race, language, and sex. RESULTS: Measurable DIF was observed for FAQ items in all groups; however, measures of effect size, latent trait distributions, and item characteristic curves suggested that the impact was minimal for research and practice. CONCLUSIONS: The FAQ is able to provide minimally biased assessments of daily functioning across diverse participants, suggesting potential value for offsetting disparities in diagnosis and treatment.

Examination of differential effects of cognitive abilities on reading and mathematics achievement across race and ethnicity: Evidence with the WJ IV.

There has been little research investigating the predictive validity of modern intelligence tests for racially and ethnically diverse students. The validity of test score interpretation within educational and psychological assessment assumes that test scores predict educationally relevant phenomena equally well for individuals, regardless of group membership (American Educational Research Association et al., 2014; Messick, 1995; Warne et al., 2014). We used multiple group latent variable structural equation modeling (SEM) to investigate Cattell-Horn-Carroll general (g) and broad cognitive abilities on reading and mathematics achievement and whether these differed between racial (African American, Asian, and Caucasian) and ethnic (Hispanic, non-Hispanic) children and adolescents within the Woodcock-Johnson IV norming sample (N = 3127). After establishing construct equivalence across racial and ethnic groups, supporting the consistent calculation of composite scores regardless of group membership, we then examined the predictive validity of intelligence on achievement. After controlling for parent education, findings suggested two instances of differential predictive relations: (a) general intelligence had larger influences on basic reading skills for Caucasians when compared to Asian peers, and (b) comprehension-knowledge had larger influences on basic reading skills for Asians when compared to Caucasian peers. The overall pattern of findings suggests there is little to no predictive bias with the WJ IV. However, the findings indicate that when latent mean differences exist (after establishing strong factorial invariance), then bias will be introduced into the estimation of regression parameters used to identify differential predictive validity. Thus, even when measurement invariance is supported, differential prediction bias is inevitable when there are mean differences in the scores used as predictors. Future test bias research should consider latent ability differences and how that may impact findings of bias, and possibly, socioeconomic status-related indicators when assessing for measurement or prediction bias in intelligence and achievement tests.

Testing for Differential Item Functioning Under the D-Scoring Method.

This study offers an approach to testing for differential item functioning (DIF) in a recently developed measurement framework, referred to as D-scoring method (DSM). Under the proposed approach, called P-Z method of testing for DIF, the item response functions of two groups (reference and focal) are compared by transforming their probabilities of correct item response, estimated under the DSM, into Z-scale normal deviates. Using the liner relationship between such Z-deviates, the testing for DIF is reduced to testing two basic statistical hypotheses about equal variances and equal means of the Z-deviates for the reference and focal groups. The results from a simulation study support the efficiency (low Type error and high power) of the proposed P-Z method. Furthermore, it is shown that the P-Z method is directly applicable in testing for differential test functioning. Recommendations for practical use and future research, including possible applications of the P-Z method in IRT context, are also provided.

Cultural Bias in Intelligence Assessment Using a Culture-Free Test in Moroccan Children.

OBJECTIVE: Previous research has shown that cognitive tests can lead to misclassification when applying non-representative norms to measure cognitive performance. The objective of this study was to investigate whether this misclassification also occurs with a non-verbal so-called "culture-free" intelligence test administered to different age groups. METHOD: The intelligence of a sample of healthy Moroccan children (N = 147) ages 7, 9, and 11 was assessed using the Coloured Raven's Progressive Matrices (CPM). Raw scores were used to study age differences, as well as misclassifications when applying the norms of three countries culturally different from Morocco (United Kingdom, Spain, and Oman). RESULTS: Intelligence performance was not within the normal range when non-representative norms were applied to the Moroccan raw scores. Misclassifications accounted for a large percentage of the participants that supposedly displayed intelligence deficits, especially when applying the British norms. Up to 15.68% of the healthy children fell within the "intellectually impaired" range, and up to 62.5% fell "below average," with these percentages especially higher at older ages. CONCLUSIONS: Our findings confirm that "culture-free" tests should be adapted to each culture and applied together with their culture's specific norms to prevent misclassification and allow for a better, unbiased neuropsychological assessment.

Typological Profiles of Depression of College Students: Latent Classes and Controlling for Response Bias of the Baptista Depression Short-Scale (EBADEP-short) / Perfis Tipológicos de Depressão de Universitários: Classes Latentes e Controle de Viés de Resposta da Escala Reduzida Baptista de Depressão - (EBADEP-short) / Tipología de la Depresión de Estudiantes Universitarios: Clases Latentes y Control del Sesgo de Respuesta de la Escala Reducida Baptista de Depresión (EBADEP-short)

Abstract Response styles and non-linearity might reduce the validity of scores on depression inventories. To address both issues, we explored the latent class structure of the Baptista's Depression Scale (EBADEP), and the influence of extreme response bias. In total, 1,137 Brazilian college students (M = 26 years, SD = 7.3) participated in this study. Taxometric analysis yielded ambiguous results, without clear support for either a dimensional or a categorical representation of the data. We found three latent classes: one comprising participants with a tendency to endorse items about sadness, angst, pessimism, and low self-efficacy; another with individuals scoring low on all symptoms; and a third with intermediate scores. We found no relationship between the composition of latent classes and extreme response. Participants who reported having received a diagnostic of depression were more likely to belong to the first latent class. These findings validate the clinical usefulness of a latent class structure for the EBADEP.

Resumo Respostas extremas e ausência de linearidade podem reduzir a validade de escores de depressão. Para abordar esse problema, este estudo teve por objetivo explorar a estrutura de classes latentes da Escala Baptista de Depressão (EBADEP) e a influência do viés de respostas extremas. Participaram 1.137 estudantes universitários brasileiros (M = 26 anos, DP = 7,3). A análise taxométrica indicou resultados ambíguos, sem um ajuste explicitamente melhor para uma estrutura dimensional ou categórica. Foram identificadas três classes latentes: a primeira, composta de participantes que tenderam a endossar itens de tristeza, angústia, negativismo e baixa autoeficácia; a segunda, de indivíduos com níveis baixos de sintomas; a terceira, com escores intermediários nos itens. Não foram encontradas relação entre as classes latentes e o estilo de respostas extremas. Participantes que relataram um diagnóstico de depressão apresentaram maior probabilidade de pertencer à primeira classe latente. Os resultados evidenciam a utilidade clínica da estrutura de classes latentes para a EBADEP.

Resumen Las respuestas extremas y la falta de linealidad pueden reducir la validez de los escores de depresión. Al abordar este problema, este estudio pretende explorar la estructura de clases latentes de la Escala de Depresión Baptista (EBADEP) y la influencia del sesgo de respuesta extremo. Participaron 1.137 universitarios brasileños (M = 26 años, DE = 7,3). El análisis taxométrico indicó resultados ambiguos, sin un ajuste explícitamente mejor para una estructura dimensional o categórica. Se identificaron tres clases latentes: la primera, compuesta por participantes que tendían a obtener altas puntuaciones en los ítems tristeza, angustia, negativismo y baja autoeficacia; la segunda, de individuos con bajos niveles de síntomas; y la tercera, con puntuaciones intermedias en los ítems. No se encontró relación entre las clases latentes y el estilo de respuestas extremas. Los participantes que informaron estar con diagnóstico de depresión tenían más probabilidades de pertenecer a la primera clase latente. Los resultados muestran la utilidad clínica de la estructura de clases latente para EBADEP.

Evidence for measurement bias of the short form health survey based on sex and metropolitan influence zone in a secondary care population.

BACKGROUND AND OBJECTIVES: The 12-item Short Form Health Survey (SF-12) is a widely used measure of health related quality of life, but has been criticized for lacking an empirically supported model and producing biased estimates of mental and physical health status for some groups. We explored a model of measurement with the SF-12 and explored evidence for measurement invariance of the SF-12. RESEARCH DESIGN AND METHODS: The SF-12 was completed by 429 caregivers who accompanied patients with cognitive concerns to a memory clinic designed to service rural/remote-dwelling individuals. A multi-group confirmatory factor analysis was used to compare the theoretical measurement model to two empirically identified factor models reported previously in general population studies. RESULTS: A model that allowed mental and physical health to correlate, and some items to cross-load provided the best fit to the data. Using that model, measurement invariance was then assessed across sex and metropolitan influence zone (MIZ; a standardized measure of degree of rurality). DISCUSSION: Partial scalar invariance was demonstrated in both analyses. Differences by sex in latent item intercepts were found for items assessing feelings of energy and depression. Differences by MIZ in latent item intercepts were found for an item concerning how current health limits activities. IMPLICATIONS: The fitting model was one where the mental and physical health subscales were correlated, which is not provided in the scoring program offered by the publishers. Participants' sex and MIZ should be accounted for when comparing their factor scores on the SF-12. Additionally, consideration of geographic residence and associated cultural influences is recommended in future development and use of psychological measures with such populations.

An examination of cultural-linguistic influences on PPVT-4 performance in African American and Hispanic preschoolers from low-income communities.

In this study, we examined potential influences of cultural and linguistic background on PPVT-4 performance in a community sample of preschool-age children from low-SES households. We did this by evaluating PPVT-4 item-level performance across African American and Hispanic children from low-income families. We compared PPVT-4 item-level performance for 332 Hispanic and African American children (Mage = 48 months) using Wald chi-square tests of independence. There were clinically significant differences in accuracy on 14 PPVT-4 test items with most favouring the African American group. We then looked at the relationship between African American English use and PPVT-4 scores for a subset of 113 African American children (Mage = 49.9 months). A correlational analysis with PPVT-4 standard scores and a dialect density measure (DDM) in narratives revealed no association between these measures. We concluded that there were potential cultural-linguistic biases in PPVT-4 items that were not explained by income alone for the young Hispanic children.

Development of the Inventory of Supporting for Socio-Emotional Skills, evidence of internal structure controlling for acquiescence / Construção, estrutura interna e controle de aquiescência do Inventário de Suporte às Habilidades Socioemocionais

This study aims to develop the Inventory of Supporting for Socio-Emotional Skills, which is an instrument for assessing the support for socio-emotional development provided by teachers, rated by students. It also aims to gather validity evidence of the internal structure of Inventory of Supporting for Socio-Emotional Skills and to control acquiescence. We elaborated the items, which content were evaluated by six experts. For the internal structure, a sample composed of elementary and high-school students (N = 443) was used to answer the instrument. The instrument presented good psychometric parameters after controlling for acquiescence using the Random Intercept Model. The final structure was set as unidimensional. We suggest controlling acquiescence to avoid biased scores. In addition, we make an inventory available that can be helpful for socio-emotional skills development.

Este estudo apresenta a construção do Inventário de Suporte às Habilidades Socioemocionais, instrumento criado para o aluno avaliar o suporte ao desenvolvimento socioemocional propiciado pelos docentes. A pesquisa pretendeu apresentar evidências de validade da estrutura interna do Inventário de Suporte às Habilidades Socioemocionais e controlar o viés de aquiescência. Para a construção dos itens, seis juízes avaliaram o conteúdo do Inventário. Para avaliar a estrutura interna, uma amostra composta por estudantes de ensino fundamental e médio (N = 443) respondeu presencialmente ao instrumento. Os resultados demonstraram bons parâmetros psicométricos do Inventário após o controle da aquiescência por meio do Modelo de Interceptos Randômicos. A estrutura foi composta por uma dimensão geral de suporte. Sugere-se o controle da aquiescência com a finalidade de evitar distorções nos escores. Ademais, disponibiliza-se um Inventário que pode ser útil ao desenvolvimento das habilidades socioemocionais dos alunos.

Development of the Inventory of Supporting for Socio-Emotional Skills, evidence of internal structure controlling for acquiescence / Construção, estrutura interna e controle de aquiescência do Inventário de Suporte às Habilidades Socioemocionais

This study aims to develop the Inventory of Supporting for Socio-Emotional Skills, which is an instrument for assessing the support for socio-emotional development provided by teachers, rated by students. It also aims to gather validity evidence of the internal structure of Inventory of Supporting for Socio-Emotional Skills and to control acquiescence. We elaborated the items, which content were evaluated by six experts. For the internal structure, a sample composed of elementary and high-school students (N = 443) was used to answer the instrument. The instrument presented good psychometric parameters after controlling for acquiescence using the Random Intercept Model. The final structure was set as unidimensional. We suggest controlling acquiescence to avoid biased scores. In addition, we make an inventory available that can be helpful for socio-emotional skills development.

Este estudo apresenta a construção do Inventário de Suporte às Habilidades Socioemocionais, instrumento criado para o aluno avaliar o suporte ao desenvolvimento socioemocional propiciado pelos docentes. A pesquisa pretendeu apresentar evidências de validade da estrutura interna do Inventário de Suporte às Habilidades Socioemocionais e controlar o viés de aquiescência. Para a construção dos itens, seis juízes avaliaram o conteúdo do Inventário. Para avaliar a estrutura interna, uma amostra composta por estudantes de ensino fundamental e médio (N = 443) respondeu presencialmente ao instrumento. Os resultados demonstraram bons parâmetros psicométricos do Inventário após o controle da aquiescência por meio do Modelo de Interceptos Randômicos. A estrutura foi composta por uma dimensão geral de suporte. Sugere-se o controle da aquiescência com a finalidade de evitar distorções nos escores. Ademais, disponibiliza-se um Inventário que pode ser útil ao desenvolvimento das habilidades socioemocionais dos alunos.

Semantic Interference Test: Evidence for Culture and Education Fairness from an Ethnically Diverse Sample in the USA.

OBJECTIVE: Tests of cognitive abilities are particularly susceptible to culture-based bias because these abilities are culturally bound. The specific purpose of this study was to examine the Semantic Interference Test, a clinical neuropsychological test, for culture bias. METHOD: The sample included 415 community-dwelling participants (mean age 74, SD = 8.32; 308 were females) living in South Florida (USA). The sample included 72 African Americans, 93 Afro-Caribbeans, 77 Hispanic Americans, and 173 European Americans. An Item Response Theory analysis of bias was employed using the Differential Item Functioning (DIF) procedure. RESULTS: Overall, the items appear to be invariant across gender, ethnicity, and education levels. Although the DIF identified several items that appear to differ across the two latter groupings, the multiple group confirmatory factor analysis (MG-CFA) suggests that these items have low impact on the overall measure. There were however, meaningful differences across age groups in the MG-CFA, suggesting that an age adjustment might be required. CONCLUSION: The SIT can be considered a cognitive test that is not significantly affected by the participants' cultural background, at least within the culture range included in this study.

Examining DIF in the Context of CDMs When the Q-Matrix Is Misspecified.

The rise in popularity and use of cognitive diagnostic models (CDMs) in educational research are partly motivated by the models' ability to provide diagnostic information regarding students' strengths and weaknesses in a variety of content areas. An important step to ensure appropriate interpretations from CDMs is to investigate differential item functioning (DIF). To this end, the current simulation study examined the performance of three methods to detect DIF in CDMs, with particular emphasis on the impact of Q-matrix misspecification on methods' performance. Results illustrated that logistic regression and Mantel-Haenszel had better control of Type I error than the Wald test; however, high power rates were found using logistic regression and Wald methods, only. In addition to the tradeoff between Type I error control and acceptable power, our results suggested that Q-matrix complexity and item structures yield different results for different methods, presenting a more complex picture of the methods' performance. Finally, implications and future directions are discussed.

Investigating the Effects of Differential Item Functioning on Proficiency Classification.

This study provides a comprehensive evaluation of the effects of differential item functioning (DIF) on proficiency classification. Using Monte Carlo simulation, item- and test-level DIF magnitudes were varied systematically to investigate their impact on proficiency classification at multiple decision points. Findings from this study clearly show that the presence of DIF affects proficiency classification not by lowering the overall correct classification rates but by affecting classification error rates differently for reference and focal group members. The study also reveals that multiple items with low levels of DIF can be particularly problematic. They can do similar damage to proficiency classification as high-level DIF items with the same cumulative magnitudes but are much harder to detect with current DIF and differential bundle functioning (DBF) techniques. Finally, how DIF affects proficiency classification errors at multiple cut scores is fully described and discussed.